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MULTISOURCE BAYESIAN SEQUENTIAL CHANGE DETECTION 

By Savas Dayanik, 1 H. Vincent Poor 2 and Semih O. Sezer 2 

j_( ■ Suppose that local characteristics of several independent com- 

CIh' pound Poisson and Wiener processes change suddenly and simulta- 

. neously at some unobservable disorder time. The problem is to detect 

the disorder time as quickly as possible after it happens and minimize 
the rate of false alarms at the same time. These problems arise, for 
example, from managing product quality in manufacturing systems 
£-H ' and preventing the spread of infectious diseases. The promptness and 

. accuracy of detection rules improve greatly if multiple independent 

information sources are available. Earlier work on sequential change 
detection in continuous time does not provide optimal rules for situa- 
tions in which several marked count data and continuously changing 
signals are simultaneously observable. In this paper, optimal Bayesian 
sequential detection rules are developed for such problems when the 
marked count data is in the form of independent compound Pois- 
son processes, and the continuously changing signals form a multi- 
dimensional Wiener process. An auxiliary optimal stopping problem 
£>^j ' for a jump-diffusion process is solved by transforming it first into a 

, sequence of optimal stopping problems for a pure diffusion by means 

f^*) ' of a jump operator. This method is new and can be very useful in 

. other applications as well, because it allows the use of the powerful 

f-**) ■ optimal stopping theory for diffusions. 

o ' 
o ■ 

1. Introduction. Suppose that at some unobservable disorder time O, 
the local characteristics of several independent compound Poisson and Wiener 
^ ' processes undergo a sudden and simultaneous change. More precisely, the 
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pairs (Aq , ), 1 < i < m, consisting of the arrival rate and mark distri- 
bution of m compound Poisson processes (Tn \ Zn^) n >i, 1 <i <m, become 
(A]/,i>{ ), 1 < i < m, and d Wiener processes W t , 1 < j < d gain drifts 
1 <j < d at time 6. 
We assume that is a random variable with the zero-modified exponential 
distribution 

(1.1) P{e = 0} = vr and P{6>t} = (l-7r) e - A ', t > 0, 

and (Ao ,fo )l<i<m, (<M ,v®)l<i<m, (/i (i) )i<i<d, vr, and A are known. The 
objective is to detect the disorder time as soon as possible after disorder 

happens by using the observations of (Tn\ Zn )n>i, l<i<m, and 

x[ j) = x { j) + ^ (t - e)+ + w t u) , t > o, i < j < d. 

More precisely, if F = {J~t}t>o denotes the observation filtration, then we 
would like to find, if it exists, an F-stopping time r whose Bayes risk 

(1.2) i? r (vr)=P{r<e} + cE(r-e) + , < ^ < 1 

is the smallest for any given constant cost parameter c > and calculate its 
Bayes risk. If such a stopping time exists, then it provides the best trade-off 
between false alarm frequency P{r < 0} and expected detection delay cost 
cE(r-e)+. 

Important applications of this problem are the quickest detection of man- 
ufacturing defects during product quality assurance, online fault detection 
and identification for condition-based equipment maintenance, prompt de- 
tection of shifts in the riskiness of various financial instruments, early detec- 
tion of the onset of an epidemic to protect public health, quickest detection 
of a threat to homeland security, and online detection of unauthorized access 
to privileged resources in the fight against fraud. In many of those applica- 
tions, a range of data, changing over time either continuously or by jumps or 
both, are collected from multiple sources/sensors in order to detect a sudden 
unobserved change as quickly as possible after it happens, and the problems 
can be modeled as the quickest detection of a change in the local character- 
istics of several Wiener and compound Poisson processes. For example, in 
condition-based maintenance, an equipment is monitored continuously by a 
web of sensors for both continuously-changing data (such as oil level, tem- 
perature, pressure) and marked count data (e.g., number, size and type of 
wear particles in the oil) ; see Byington and Garga [6] . For the assessment of 
financial risks of an electricity delivery contract, the spot price of electricity 
is sometimes modeled by a jump-diffusion process; see, for example, Weron, 
Bierbrauer and Truck [18] and Cartea and Figueroa [7]. 

In the past, the Bayesian sequential change-detection problems have been 
studied for Wiener processes by Shiryaev [17, Chapter 4] and for Poisson 
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processes by Peskir and Shiryaev [14, 15], Gapeev [10], Bayraktar, Dayanik 
and Karatzas [2, 3] and Dayanik and Sezer [9], but have never been con- 
sidered for the combination of Wiener and Poisson processes. Clearly, an 
unobserved change can be detected more accurately if there are multiple 
independent sources of information about the disorder time. If all of the 
information sources consist of exclusively either Wiener or Poisson process 
observations, then the problem can be solved by applying the results of 
Shiryaev ([17], Chapter 4) in the Wiener case and Dayanik and Sezer [9] 
in the Poisson case to a weighted linear combination or superposition of all 
observation processes; see Section 5. If Wiener and Poisson processes can be 
observed simultaneously, then previous work does not provide an answer; 
the solution of the problem in this case is the current paper's contribution. 

We solve the problem in detail for m = d= 1 , namely, when we observe 
exactly one Wiener and one Poisson process simultaneously; in Section 5 
we show the easy extension to multiple Wiener and multiple Poisson pro- 
cesses. Therefore, except in Section 5, we drop all of the superscripts in the 
sequel. We show that the first time tu^) = inf{t > 0; 3>t > 4>oo} that the 
conditional odds-ratio process 



enters into some half-line [0oo,oo) C M+ gives the smallest Bayes risk. To 
calculate the critical threshold (poo and the minimum Bayes risk, we reduce 
the original problem to an optimal stopping problem for the process <E>, 
which turns out to be a jump-diffusion jointly driven by the Wiener and 
point processes; see (2.8) for its dynamics. The value function of the optimal 
stopping problem satisfies certain variational inequalities, but they involve 
a difficult second order integro-differential equation. 

We overcome the anticipated difficulties of directly solving the variational 
inequalities by introducing a jump operator. By means of that operator, we 
transform the original optimal stopping problem for the jump-diffusion pro- 
cess $ into a sequence of optimal stopping problems for the diffusion part 
Y of the process $ between its successive jumps. This decomposition al- 
lows us to employ the powerful optimal stopping theory for one-dimensional 
diffusions to solve each sub-problem between jumps. The solutions of those 
sub-problems are then combined by means of the jump operator, whose role 
is basically to incorporate new information about disorder time arriving at 
jump times of the point process. 

Solving optimal stopping problems for jump-diffusion processes by sepa- 
rating jump and diffusion parts with the help of a jump operator seems new 
and may prove to be useful in other applications, too. Our approach was 
inspired by several personal conversations with Professor Erhan C^inlar on 
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better ways to calculate the distributions of various functional of jump pro- 
cesses. For Professor Cmlar's interesting view on this more general matter, 
his recent lecture [8] in honor of the 2006 Blackwell-Tapia prize recipient, 
Professor William Massey, in the Blackwell-Tapia conference, held between 
3—4 November 2006, may be consulted. 

In Section 2 we start our study by giving the precise description of the 
detection problem and by modeling it under a reference probability mea- 
sure; the equivalent optimal stopping problem is derived, and the condi- 
tional odds-ratio process is examined. In Section 3 we introduce the jump 
operator. By using it repeatedly, we define "successive approximations" of 
the optimal stopping problem's value function and identify their important 
properties. Their common structure is inherited in the limit by the value 
function and is used at the end of Section 4 to describe an optimal alarm 
time for the original detection problem. Each successive approximation is 
itself the value function of some optimal stopping problem, but now for a 
diffusion, and their explicit calculation is undertaken in Section 4. The suc- 
cessive approximations converge uniformly and at an exponential rate to the 
original value function. Therefore, they are built into an efficient and accu- 
rate approximation algorithm, which is explained in Section 6 and illustrated 
on several examples. Examples suggest that observing Poisson and Wiener 
processes simultaneously can reduce the Bayes risk significantly. Baron and 
Tartakovsky [1] have recently derived asymptotic expansions of both opti- 
mal critical threshold and minimum Bayes risk as the detection delay cost c 
tends to zero. In Section 6 we have compared in one of the examples those 
expansions to the approximations of actual values calculated by our numer- 
ical algorithm. Finally, some of the lengthy calculations are deferred to the 
Appendix. 

2. Problem description and model. Let (Q,J-,W) be a probability space 
hosting a marked point process {(T n , Z n );n > 1} whose (E, £)- valued marks 
Z n , n > 1 arrive at times T n , n > 1, a one-dimensional Wiener process W, 
and a random variable with distribution in (1.1). The counting measure 

oo 

p((0,t]xA))^Y^l {0 ,t]xA(T n ,Z n ), t>0,Ae£ 

n=l 

generates the internal history ¥ p = {J rp }t>o, 

4 a{p((0, s] x A); < s < t, A G £ }, 

of the marked point process {(T n , Z n );n > 1}. At time 0, (i) the drift of the 
Wiener process W changes from zero to //, and (ii) the (P, F p )-compensator 
of the counting measure p(dt x dz) changes from X^dtv^dz) to \\dtvi{dz). 
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The process W is independent of G and (T n ,Z n ) n >i. Neither W nor 6 are 
observable. Instead, 

x t = x + fi(t-e)+ + w t , t>o 

and {(T n , Z n );n > 1} are observable. The observation filtration F = {J~t}t>o 
consists of the internal nitrations of X and (T n , Z n ) n >i; that is, 



T t = T?\JT v t and = a{X s ; < s < t} for every t > 0. 

If we enlarge F by the information about and denote the enlarged filtration 
by G = {g t } t > , 

g t ±F t Va{&}, t>0, 

then for every nonnegative G-predictable process {H(t, z)}t>o indexed by 
z £ E, we have 



E 



H(s, z)p(ds x dz) 



'(0,oo)xE 

where E is the expectation with respect to P, and 

X(s,dz) = \ vo(dz)l[ 0i e)(s) + Aii/i (cfe)l[e,oo)(s) 



H(s, z)X(s, dz) ds 



s>0, 



is the (F, G)-intensity kernel of the counting measure p(dt x dz); see Bremaud [5], 
Chapter VIII. 

The rates < A, Ao, Ai < oo, the drift /i 6 M. \ {0}, and the probability 
measures ^o(')> ^i(') on {E,£) are known. The objective is to find a stopping 
time r of the observation filtration F with the smallest Bayes risk R T (ir) in 
(1.2) for every ir G [0,1). 

Model. Let (£l,J-, Po) De a probability space hosting the following inde- 
pendent stochastic elements: 

(i) a one-dimensional Wiener process X = {X t ;t > 0}, 

(ii) an (E, ^-valued marked point process {(T n , Z n );n > 1} whose count- 
ing measure p(dt x dz) has (Po,F p )-compensator Ao dt v^{dz) , 

(iii) a random variable G with zero-modified exponential distribution 



(2.1) 



» {e = o} = 7r, 



,{9 > t} = (1 - ?r)e 



-At 



t>0. 



Suppose that v\{-) is absolutely continuous with respect to vq(-) and has the 
Radon-Nikodym derivative 



(2.2) 



dv\ 
dvo 



z£E. 
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Define a new probability measure P on = Vj>o @t locally by means of 
the Radon-Nikodym derivative of its restriction to Qt, 

^ — P — ~\ + 1 Lt 

— ^-P t -l {t<e} + l {t > e} — , 



t>0, 



where 



(2.3) L^expj/xXt-^ + Ax-Ao)*} II 

is a likelihood-ratio process with the dynamics Lq = 1, and 

'Ai 



t>0 



(2.4) 



dL t = L t fidX t + L t _ I 
Je 



E \Aq' 



/(z) - 1 [p(di x dz) — \ dtv {dz)], 



t > 0. 



Under the probability measure P, the processes X and {(T n , Z n );n>l} and 
the random variable jointly have exactly the same properties as in the 
above description of the problem. Moreover, the minimum Bayes risk U(-) 
can be written as 



(2.5) U(ir) = inf R T (ir) = 1 - tt + c(l - tt)V 

tGF 



7T 



1-7T 



TT E [0, 1) 



in terms of the value function 



(2.6) V(<t>)±ME$ 



o 



e- M g($ t )dt 



(f> > 0, where <?(</>) — 



A 



of the optimal stopping problem above for the conditional odds-ratio process 
<I> in (1.3); see, for example, Bayraktar, Dayanik and Karatzas [2, Proof of 
Proposition 2.1]. In (2.6), the expectation Eg is taken with respect to Po 
conditionally on &o = 4> >0. Bayes formula gives for every t > that 

E [£ t l {e <* } | T t \ 



(2.7) 



$ * E [£ t l { e>t} I H 

E [(Li/L e )l { e<t} \H 

p {e > t} 

= $ e Xt L t + fxe^^ds- 

JO Lis 

by the chain rule and dynamics in (2.4) of the likelihood-ratio process L we 
find that 



(2.8 



d$ t = (A + a$t) dt + $ t /i dX t 

+ $t-f E (j^f(z)-l)p(dtxdz), t>0, 
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where 

a = A — Ai + Ao- 
Let us define for every k > that To = if ^ = 0, and 

xW±X Tk+u -X Tk , u>0, 
(Tf } , zf } ) 4 (T fc+ , - T fc , Zfc+e), I > 1, 

JFf 4 a{(T n , Z n ), l<n<k}\J a{X v ,0 <v< T k }, 

4 jtf) v a {(Ti k \zf ] )-Q < if ) < u} V .{I^O < u < «}, 

u>0, 

r (fc) a jgVHf 



expj^-^ + ^-Ao).} n (^/(^ 



0<T„ (fc) <t 



u>0. 



Then, as in (2.7), we have 
(2.9) 



a- 



t— T fc T 

Xe x(t-T k -u)^n du ^ t>T k ,k>o, 



of the marked point process {(if , 2f > 1}, whose local (Po, {-^n^lu; 
characteristics are (Ao, ^o(')) f° r every A; > 0, since Aft ) = X, {(Tp°\ zi°^)}^>i = 



and = {AT j , it > 0} is a (P , {A ' } u >o)-Wiener process and Po-independent 

x>o) 

') 7 (0) 

{(T n , Z n )} n >i, and {-T^ji^o = P- Thus, the first of two implications of (2.9) 
is that for every Borel h : M+ \—> M+ we have 

E^[/ J ($ t )l {t > Tfe} | ^ r J = l { i> Tfc } E Tfc [M^)]U-T fc , fe > 0, 

which also follows from the strong Markov property of the process $ applied 
at the stopping time T k of the filtration P. To state the second implication, 
let us introduce the processes 

Y*>y = ye AM exp jrf) -(^- + \ x - A )u} 
(2.10) + £ Xe x{u ~ s) exp^(X^ - 1^) 
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for every u,k,y > 0, which is (2.9) with u = t — and y = $r fe after all of 
future jumps are stripped away. Then for every k > 0, the process {Y k,y ,u > 
0} is a diffusion on M + with the dynamics 



(2.11) 



dY?> v = (\ + aYf> v )dt + f iYf' v dxl k) , t>0 and 
Yq' v = y>0, k>0. 



bince we shall drop the superscript from Y 0,v and denote that 

process by Y y . Because for every k > 0, x( fc ) is a Wiener process, the pro- 
cesses Y k ' y , k>0 and Y y have the same finite-dimensional distributions, 
and (2.9) implies that 

f*£??, ie[T fe ,T fc+1 ), 
(2.12) $t=\ \i 

\fm + ^ t=r k+l . 

The superscript in l^r* = ^' y |j/=$ T ,u=t-T k indicates that, when {i„ i: ' 2/ ; u > 
0} is calculated according to (2.10) or (2.11), the increments of the driving 

Wiener process {X„ ; u > 0} are those of the process X after the kth arrival 
time Tfc of the marked point process. 

3. Jump operator. Let us now go back to the optimal stopping prob- 
lem in (2.6). By (2.12), we have $ t = Y t °'®° = Y?° for < t < T x . This 
suggests that every F-stopping time r coincides on the event {r < T{\ 
with one of the stopping times of the process Y®°. On the other hand, 
the process $ regenerates at time T\ starting from its new position $t x = 
(Ai/A )/(Zi)Y*°. Moreover, on the event {t > T\}, the expected total run- 
ning cost KqUq 1 e~ xt g(Y®°) dt] incurred until time T\ is sunken at time T±, 
and the smallest Bayes risk achievable in the future should be V(3?Ti) inde- 
pendent of the past. Hence, if we define an operator J acting on the bounded 
Borel functions w : M+ i— > M according to 

/ e- xt g^ t )dt + l {T>Tl} e- XT ^w^ Tl ] 
Jo 



(Jw)(<f>)^ inf Eg 

r£W x 

(3.1) 

d>>0 



then we expect that V(4>) = (JV)(4>) for every (f> > 0. In the next section 
we prove that V(-) is indeed a fixed point of w i— ► Ju>, and if we define 
v n :M+ i— ► K, n > 0, successively by 

(3.2) v (-)=0 and v n+1 (-) 4 (Ju n )(.), n > 0, 
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then {v n (-)} n >i converges to V(-) uniformly. This result will allow us to 
describe not only an optimal strategy, but also a numerical algorithm that 
approximates the optimal strategy and the value function. 

Note that the infimum in (3.1) is taken over stopping times of the Wiener 
process X. Since X and the marked point process (T n ,Z n ) n >i are Po- 
independent, the decomposition in (2.12) and some algebra lead to 



(3.3) (Jw)(6) = inf 

re¥ x 



>0, 



where K is the operator acting on bounded Borel functions w : M+ i— ► K 
according to 

(3.4) {Kw){4>)± J E w(j±f(z)<fyvo(dz), <P>0, 

where /(•) is the Radon-Nikodym derivative in (2.2). The identity in (3.3) 
shows that (Jw)(cp) is the value function of an optimal stopping problem 
for the one-dimensional diffusion = Y ^, whose dynamics are given by 
(2.11). Standard variational arguments imply that, under suitable condi- 
tions, the function Jw(-) satisfies 

= wm{-(Jw)(<t>), [Ao - (A + \ )){Jw)(4>) + g(<f>) + A o (A^)(0)}, 

(3.5) 

0>O, 

where for every twice continuously-differentiable function w : M+ i— > M, 



(3.6) (Aow)(<l>) = y^"^) + ( A + ^)w'(^) 

is the (Pq, F)-infinitesimal generator of the process Y y , with drift and diffu- 
sion coefficients 

(3.7) = A + a<p and cr{4>) — n<t>, 

respectively. If both w and Jw are replaced with V, then (3.5) becomes 

(3.8) = mm{-V(4>),(A-X)V^)+gm, > 0, 
where for every twice continuously-differentiable function w : M+ i— > M, 

(3.9) (Aw)(4>) — (Aow)((/>) + X [(K - l)w]((j)), 0>O 

is the (Po,F)-infinitesimal generator of the process $ in (1.3)-(2.8). The 
identity in (3.8) coincides with the variational inequalities satisfied by the 
function V(-) of (2.6) under suitable conditions. This coincidence is the 
second motivation for the introduction of the operator J in (3.1) and for the 
claim that V = JV must hold. 
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Reversing the arguments gives additional insight about the role of the 
operator J. If one decides to attack first to the variational inequalities in 

(3.8) for V(-), then she realizes that solving integro-differential equation 
(.4 — X)V + g = is difficult. Substituting into (3.8) the decomposition in 

(3.9) of the operator A due to diffusion and jump parts gives 



= mm{-V((/>), [Ao - (A + \ )]V(<f>) + g(<j>) + Xo(KV)(<t>)}, 4> > 0. 



Now [Ao — (A + \o)]V(4>) + g{4>) + \q{KV){4>) = is a nonhomogeneous sec- 
ond order ordinary differential equation (ODE) with the forcing function 
—g — X(KV). If one wants to take full advantage of the rich theory for the 
solutions of second order ODEs, then she only needs to break the cycle by 
replacing the unknown V in the forcing function with some known func- 
tion w and call by Jw the solution of the resulting variational inequalities, 
namely, (3.5). By repeatedly replacing w with Jw, one then hopes that J n w 
converges to V as n — > oo. As the next remark shows, the jump operator 
J can be applied repeatedly to bounded functions, since Jw is bounded 
whenever w is bounded. 

Remark 3.1. For every bounded i— > M, the function Jw:M. + i— > 

R_ is bounded, and 



where ||u> _ || is the sup-norm of the negative part of w(-). If w is bounded 
and w(-) > — 1/c, then > (Jw)(-) > — 1/c. If i«:R + ]R is concave, then 
so is Jw : i— > M_ . The mapping w \— > Jw on the collection of bounded 
functions is monotone. 

Proof. Suppose that w(-) is bounded. Since r = is an F^-stopping 
time, we have (Jw)(-) < 0. Since (Kw)(-) > — \\w~ \\ and g(&t) = ^t~ (A/c) > 
— A/c for every t > 0, we have 



If w(-) > —1/c, then |[ < 1/c and > (Jw)(-) > —1/c. Suppose that w(-) 
is concave. The explicit form in (2.10) indicates that = Y®' y is an affine 
function of Yq = Y ' y = y. Since g(-) is affine and (Kw)(-) is concave, the 
mapping y \— > g{Y y ) + Xo(Kw)(Y y ) is also concave. Therefore, the integral 
in (3.3) and its expectation are concave for every F x -stopping time r. Be- 
cause (Jw)(-) is the infimum of concave functions, it is also concave. The 
monotonicity of w *— > Jw is evident. □ 
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Remark 3.2. For every cj) > 0, we have E£[ J °° e~ xt <S>t dt] 



oo, 



Et 



/ e ~(A+Ao)t $tdt 
J 

e -(A+Ao)tv*o dt 



>+l 

Ao 



1 



a7'* + 



A + Ao 
1 

A + An 



Proof. The proof follows from (2.7), (2.10), Fubini's theorem, and 
I o,E)-martingale property of L = {Lt;t > 0} after noting that 



E^ = (l + </>)e A *-l 



and 



EqV 



X[ P ( A - A i+ A o)* _ 11 
ie (A-A!+A )t + rMf ii 



A - Ai + A 



o 



□ 



Remark 3.3. The sequence {v n (-)} n >o in (3.2) is decreasing, and the 
limit Uoo(0) — hm n ^ 00 v n (<p) exists. The functions (j) l— * v n{4')i < n < oo, 
are concave, nondecreasing and bounded between — 1/c and zero. 

Proof. We have t>i(</>) = (Jvo)((p) < = vq, since stopping immediately 
is always possible. Suppose now that v n < v n -\ for some n > 1. Then v n +i = 
«/w n < Jv n -i = v n by Remark 3.1, and {f n (-)}n>l is a decreasing sequence by 
induction. Since vq = is concave and bounded between and —1/c, Remark 
3.1 and another induction imply that every v n (-), 1 < n < oo, is concave and 
bounded between —1/c and 0. Finally, every concave bounded function on 
M+ must be nondecreasing; otherwise, the negative right-derivative at some 
point does not increase on the right of that point, and the function eventually 
diverges to — oo. □ 



Lemma 3.1. The function Voo(-) = lim,, 
solution of the equation w(-) = (Jw)(-). 



,v n (-) is the unique bounded 



Proof. Since by Remark 3.3 {i>n(-)}n>o is a decreasing sequence of 
bounded functions, the dominated convergence theorem implies that 



Voc(<j>) 



inf v n+1 {<j>) 

n>l 



inf inf E 

n>l r gF x 

inf inf E 

rG F x n>l 

inf E^ 

{JVoo){4>)- 



-{\+\o)t 



\g(Y*°) + \ (Kv n )(Y t *°)}dt 



e- (A+Ao)i bOf °) + \ (Kv n )(Y* )] dt 



-(A+A )t 



g(Y*o) + Xo[K inf \v n )(Y*°) 

n>l 



dt 
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Let ui(-) and 1*2 (•) be two bounded solutions of w = Jw. Fix any arbitrary 
<p € M+ and e > 0. Because (Jui)(<j)) is finite, there is some t\ = ti(</>) € ¥ x 
such that 



ui(0) = (J«i)(^)>E{ 







~ (A+Ao)< (5 + A (A' Ul ))(y* )^ 



Because -ffui — -fTu2 = if (iti — ^2) < || n i — u 2\\, we have 

rn 



U!(<f>)<E. 







E 



< ||u 2 - ni| 



(A+Ao) t(5 + Ao(irn2))(y *o ) ^ 
e -(A+Ao) i(5 + Ao(E:Ul))( y*o ) ^ 



A -(A+A )t + £ < 



Ao 



+ e 



\U2 — ui\\+ e. 



A + A ' 

Since e is arbitrary, this implies U2{4>) — ui((p) < [Ao/(A + Ao)]||u2 — Ui\\. 
Interchanging u\ and u 2 gives Ui(0) — 1*2(0) < [Ao/(A + Ao)]||«2 — an d 
the last two inequalities yield \u\(<p) — ti 2 (0)| < [Ao/(A + Ao)]||iti — u 2 || for 
every 4>>0. Therefore, ||tti — 1*2 1| < [Ao/(A + Ao)]||ui — it 2 ||, and because 
< Ao/(A + Ao) < 1, this is possible if and only if \\u\ — U2W = 0; hence, 
u\=U2- Therefore, w = is the unique bounded solution of w = Jw. □ 

Lemma 3.2. The sequence {v n ((p)} n >o converges to i>oo(0) as n — > 00 
uniformly in (f> > 0. More precisely, we have 



(3.10) v OQ ( ( j))<v n ((P)<v OD ( ( f)) + - 



Ao 



C VA + Ar 



Vn>O,V0>O. 



Proof. The first inequality follows from Remark 3.3. We shall prove 
the second inequality by induction on n > 0. This inequality is immediate 
for n = since — 1/c < Uoo(-) < 0. Suppose that it is true for some n > 0. 
Then induction hypothesis implies that 



v n+ i(4>) = inf Eq 

reF x 

< inf E* 



(A + A )t [5(F * 0) + Ao( ^ n)(y *o )] ^ 



-(A+A )t 



+ A (^oo)(^°) + 



A 



A 







< inf ( E; 

tGF^ 



J 



c V A + A 
e _ (x+Xo)t[g{Y s 0) + MKVoo){Y * 0)] dt 



dt 
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+ r e -(»w*(*°) dt 

Jo c \X + X 0/ 



foo(<A) + 



1/ An 



C V A + An 

since Voo = Jvqo by Lemma 3.1. □ 

4. Solution of the optimal stopping problem. The main results of this 
section are that Uoo(0 coincides with the value function V(-) of the optimal 
stopping problem in (2.6), and that the first entrance time of the process <3? 
of (1.3) into half line [</>oo,oo) for some constant </>oo > is optimal for (2.6). 
We also describe e-optimal F-stopping times for (2.6) and summarize the 
calculation of its value function V(-). 

We shall first find an explicit solution of the optimal stopping problem 
in (3.3). The second order ODE (A + Aq)^(-) = Aoh(-) on (0, oo) admits 
two twice-continuously differentiable solutions, ip(-) and r/(-), unique up to 
multiplication by a positive constant, such that they are increasing and de- 
creasing, respectively. For this and other facts below about one-dimensional 
diffusions, see, for example, Ito and McKean [11], Borodin and Salminen [4] 
Karlin and Taylor [12], Chapter 15. 

The explicit form in (2.10) of the process Y y = Y 0,v suggests that the 
process may start at y = 0, but then moves instantaneously into (0, oo) 
without ever coming back to 0. It can neither start at nor reach from inside 
to the right boundary located at oo. Indeed, calculated in terms of the scale 
function S(-) and speed measure M(-), defined respectively by 

S(dy) = exp{— 2 / ^ \ du\ dy, y>0 and 

(4 1) 

for some arbitrary but fixed constant c > 0, Feller's boundary tests give 

(4.2) 5(0+) = -oo and T / M(dy)S{dz) < oo, 

Jo Jo 

/•oo /*oo /*oo /*oo 

(4.3) / / S(dy)M(dz) = oo and / / M(dy)S(dz 

J c J z J c J z 



IZ = OO, 



as shown in Appendix A.l, and according to Table 6.2 of Karlin and Taylor 
([12], page 234), we conclude that y = and y = oo are entry-not-exit and 
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natural boundaries of the state-space [0,oo), respectively. Therefore, tp(-) 
and r/(-) satisfy boundary conditions 



< ip(0+) < oo, 77(0-1-) = 00 

hm — — = 0, lim —— > -c 

y^0+ S'(y) y-*0+ S'(y) 



(4.4) 

i/)(oo) = 00, 77(00) = 0, 

hm TTTT = 00 ) lim "cvTT = °- 
6'(y) <S (y) 

We shall set ip(0) =^(0+) and 7/(0) = ??(0+). The Wronskian £(•) of ^(-) 
and 77(-) equals 

(4.5) B(y)^4>'(y)ri(y)-i;(y)r ] '(y) = B(c)S , (y), y > 0, 

where the constant c and that in the scale function S(-) in (4.1) are the same. 
The second equality is obtained by solving the differential equation AoB = 0, 
which follows from the equations Aoip = (A + \o)tp and Aqt] = (A + Ao)?? after 
first multiplying these respectively with 77 and tfj, and then, subtracting from 
each other. Observe that 

„, , B(y) <p'(y) rf{y) 

B ^ = m = m" {v) - m m' v -° 

is constant. Dividing (4.5) by —ip 2 (y) and then integrating the equation give 
(a a\ rtv) ^c) f y u( v S'{z) 

This identity implies that the constant B{c) must be strictly positive, since 
the functions ip(-) and 77(-) are linearly independent [note that their nontriv- 
ial linear combinations cannot vanish at because of (4.4)]. 

For every Borel subset D of M+, denote the first entrance time of Y y 
and $ to D by 

(4.7) t d = mf{t > : Y t y G D} and f D = inf {t > : $ t 6 £>}, 

respectively. If D = {z} for some z € K+, we will use t z (t z ) instead of 
T {z}(%})- Then 

^ ^ Vz>0,Vy>0, 
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which can be obtained by applying the optional sampling theorem to the 
(P ,F)-martingales {e-( x+x °^ip(Y t v );t > 0} and {e-^ x+x °^ri(Y t y );t > 0}. For 
every fixed real number z > 0, (4.8) implies that 

>Cs)Eg[e-( A+Ao > T -], 
E z [e-( A + A o) r s/]' 

r)(y) = \ E^[e-( A + A o)^]' 

V (z)E y [e-( x+Xo ^}, 

and suggests a way to calculate functions ip(-) and rj(-) up to a multiplication 
by a constant on a lattice inside (0, z] by using simulation methods. Let us 
set ijj(z) = v( z ) = 1 ( or to any arbitrary positive constant), and suppose that 
the grid size h > and some integer iV are chosen such that Nh = z. Let 
z n = nh, n = 0, . . . , N. Then (4.8) implies that one can calculate 




(4.9) 



^(z n+ i)E^[exp{-(A + A )r Zn+1 }], 
??(z n+1 )/E^ +1 [exp{-(A + A )r z J], 



n = N- 1,...,1,0, 
n = JV-l,...,l,0, 



backward from z^ = z by evaluating expectations using simulation. 

The functions ip(-) and rj(-) can also be characterized as power series 
or Kummer's functions; see Polyanin and Zaitsev ([16], pages 221, 225, 229, 
Equation 134 in Section 2.1.2). Those functions take simple forms for certain 
values of A, Ai, Ao and /i. For example, if a = A + Ao — Ai > and 

(n - 1)A = (n - 2)[(A + A ) + ±/i 2 (n - 1)] 

for some n G N and n > 2, 

then ip(-) is a polynomial of the form = J2k=o Pk<p k , where [3q = 1, 
fa = (A + A )/A, and 



(A + A ) - (fc - l)a - 0.5/x 2 (A: - l)(fc - 2) 
kX 



P k -i for k>2, 



and r/(-) can be obtained in terms of ip{-) from (4.6). However, we make 
no such assumptions about the parameters and work with general tp(-) and 
*/(•)• 



Lemma 4.1. Every moment of the first entrance times Tr r>00 -\ and t\ Tj00 \ 
of the processes Y and respectively, into half line [r, oo) is uniformly 
bounded for every r > 0. 
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Proof. Fix r > and < (f> < r; the cases r = or (j> > r are obvious. 
Since the sample paths of Y®° are continuous, we have T[ rj00 ) = r r , and (4.8) 
implies that 



(4.10) 



){ Tr <T 1 } = E^e- A()TV > E^e~ (A+Ao)T '' 

-W)>M e(0|1) , 06[ „, r) . 



ifj(r) V'( r ) 

Let a = VI - C0(°)AH r )) < 1. The strong (P , F)-Markov property of Y* 
implies that 



(4.11) 



= Pj{r r >T r ^i ) r r >T n } 

^o[l{r f >T„_ l} (l{r r >T l} ° 0T n _J] = E^l^^P^"" 1 {T,. > ?\}] 



<PS{r r >T B _i} 





< 


L ^(0)1 









a 



2d 



by induction on n, because Y^?° £ [0, r) on {r r > T n } for every n > 1. For 
every fe > 1, 



E^<E^T n fc +1 l { T„<. r <T„ +l} 

n=0 

oo oo 

(4.12) < Y: ^ +1 l {Tr>Tn} < £ ^/E^PoVr > T n } 



n=0 



n=0 



n=0 



ri=0 



independent of the initial state > 0. Since Po{ r [r,oo) < ^1} = ^o{ T r < T±} > 
ip{Q)/tp{r) for every <j) € [0, r) by (4.10), both (4.11) and (4.12) remain correct 
if we replace r r and Y T °_ 1 with T[ r oo ) and 3>t„_i> respectively. □ 

Assumption. In the remainder, suppose that u; : i— > M is an arbitrary 
but fixed bounded and continuous function, and < I < r < oo. 



Define 



(4.13) 



(H ltr w)(<f>)±Et 



r [0,i] Ar [r,oo) 







< X + X ^(g + \o(Kw))(Y t *°) dt 



>o, 
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(H r w)(<i>) ±E+ 



[r,oo) 



< x + x «)\ g + \ (Kw)){Y*°) dt 



>0. 



We shall first derive the analytical expression below in (4.16) for (H r w)(-). 
Since the left boundary at is entrance-not-exit for the process 1"*°, that 
boundary is inaccessible from the interior (0, oo) of the state-space, and 
linn^o 7 "; A T r = T r PQ-a.s. for every (j) > 0. Because (Kw)(-), is bounded, 
and g{4>) = (j) — (A/c), <^> > 0, is bounded from below, Remark 3.2 and the 
monotone convergence theorem imply that 



(4.14) 



(H r w)(^ = lrni(H Wr w)(^, 

(H r w)(0) = l^lna(H l , r w)(4>) 
4>\0l\0 



> and 



follows from the strong Markov property; see Appendix A. 2 for the details. 
By means of the first equality, the second becomes (H r w)(0) = lim^o^r^) (</>), 
that is, the function (j) \— > (H r w)(4>) is continuous at (ft = 0. In terms of the 
fundamental solutions 

Mv) - i>(v) - -^TKViy) and T) r (y) = r)(y) - ^j\^{y) 

of the equation [Ao — (A + Xo)]h(y) = 0, I < y < r with boundary conditions 
h(l) = and h(r) = 0, respectively, and their Wronskian 

we find, as shown in Appendix A. 3, that 

{H hr w){<t>) 

2r] r (z) 



r)(l) i/j(r) 



(4.15) 



<t> V 2 (z)Bl tr (z) 



i a 2 (z)B ljr (z) 



(g+ X {Kw))(z)dz 
(g + X (Kw))(z)dz, 



0<l<6<r, 



where cr(z) = fiz is the diffusion coefficient of the process Y*° in (3.7). After 
taking the limit as / \ 0, the monotone convergence and boundary condi- 
tions in (4.4) give 



(H r w)(4>) 



(4.16) 



2 V (z) 



</, a 2 (z)B(z) 



(g + X (Kw))(z)dz 



18 



S. DAYANIK, H. V. POOR AND S. O. SEZER 



+ v(4>) 



V#) 



o <r 2 (z)B(z) 



(g + X (Kw))(z) dz 



r/(r) 



2ij>{z) 



-(g + X (Kw)){z)dz, 



0<cb<r, 



iP(r)J a 2 {z)B(z) 

and (H r w){0) = lim^o^r^)^) by (4.14). Finally, (H r w)(<f>) =0 for ev- 
ery <fi > r by the definition in (4.13). For every r > 0, the function eft 
(H r w)(<p) is continuous on [0, oo); it is twice continuously-differentiable on 
(0, oo), possibly except at <j) = r. Direct calculation shows that (H r w)(r) = 
(H r w)'(r+) = and 



[H r w)'{r-) 



o a 2 {z)B{z) 



(g + X (Kw)){z) dz. 



Since z\— >i](z) — [i](r)/'ip(r)]'ip(z) is strictly decreasing 
(H r w)'(r-) = 

2tp{z 



(4.17) 



(Gw)(r) 



o a 2 (z)B(z) 



(g + X (Kw)){z)dz = 0. 



Lemma 4.2. Ifw(-) is nondecreasing and nonpositive, then (Gw)(4>) = 
has exactly one strictly positive solution (f> = <fi[w]. If we denote by 4>e[w] the 
unique solution (j) of (g + Xq(Kw) )((f)) = and define 4> r [w] = (/)[— \\w\\], then 
4>i[ w ] — 4>[ w ] — ^rH 1 Moreover, (Gw)((p) is strictly negative for 4> € (0, </>[«;]) 
and strictly positive for <f> £ (<f)[w], oo). 

Proof. Since <fi h-> (g + X (Kw) )((/)) = <j>— (A/c) + Xq{Kw){4>) is negative 
at <fi = and increases unboundedly as (ft — > oo, it has unique root at some 
(f> = (f>l[w] > 0. Therefore, 

{Gw) '^ = ^m {9+Xo{Kwm) 

changes its sign exactly once at <j> = (j)i[w\, from negative to positive, and 
the continuously differentiable function (Gw)((j)) = fQ(Gw)'(z)dz is strictly 
negative on (0, Since (Gw){4>) is increasing at every <\> E [<^[io],oo), 
the proof will be complete if we show that lim^^ 00 (Gio)'(i^) = oo. Since 
a 2 (4>) = n 2 4> 2 , and 

S"(0) = exp{-2 f^^^du) = const, x expl^l^ 2 ^ 
we have 



fi 2 U 2 J Ifl 2 <j) 



lim (GuO'ft) = Km J^g^ = const, x Uxa , 



MULTISOURCE BAYESIAN SEQUENTIAL CHANGE DETECTION 19 

which equals oo if 1 — (2a/ // 2 ) < 0. Otherwise, the L'Hospital rule and (4.4) 
give 



2A 1 

Finally, constant function wq{^>) = — ||to||, <^> > 0, is also bounded continuous 
nondecreasing and nonpositive. By the first part of the lemma, {Gwq){4>) = 
has exactly one strictly positive solution <fi = 4>[wq\ =: (j) r \w\. Since w(-) > 
— \\w\\, we have (Gw)(-) > (Gwq)(-), and therefore, </>[w] < <f> r [w\. □ 

Lemma 4.2 and (4.17) show that in the family of functions {H r ((p),(f> € 
M + } r> o there is exactly one function that "fits smoothly at cj> = r" and 
is therefore continuously differentiable on the whole 0G (0, oo), and that 
function corresponds to the unique strictly positive solution r = <j)[w\ of the 
equation (Gw)(r) = in (4.17). 

Lemma 4.3. Suppose that w(-) is nondecreasing and nonpositive. Then 
the function 

(4.18) (Hw)(<f>)^(H^ [w] w)(<l>), 0>O, 

equals zero for <f> > (f)[w] and 

^ / V w d 9 + MKw))(z)dz 
J,/, a z (z)B(z) 

+ ^ I' A 9 + Xo(Kw))(z)dz 

Jo a z (z)B(z) 

for < 4> < 4>[w\. It is bounded continuous on [0, oo), continuously differen- 
tiable on (0,oo) and twice continuously differentiable on (0, oo) \ {</>[«;]}. It 
satisfies (Hw)(<p[w]) = (Hw)' (4>[w]) =0 and the variational inequalities 

f (Hw)(<f>)<0\ 
I [Ao - (A + \ ))}(Hw)(<f>) + {g + X (Kw))(<f>) = J ' 

r (h w )(0) = oi 

\ [A - (A + A o )](#™)(0) + ( 5 + MKw))(<j>) > J ' 

(^H,oo). 



lim (Gw)'((f)) = const, x lim 



const, x lim —7— - exp 

<£->oo S'((/>) 



(4.19) 
(4.20) 
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Proof. The explicit form of (Hw)(-) follows from (4.16) after notic- 
ing that the third term equals — ijj(<p)[r}(r) /x/j(r)](Gw)(r) and vanishes for 
r = 4>[w\ by definition. Since (H r w)(-) is continuous on [0,oo) and twice 
continuously differentiable on (0, oo) \ {r} and (H r w)(r) = for every r > 0, 
so is (Hw)(-) = (H^^w)^) and (Hw)((fr[w]) = 0. It is also continuously 
differentiable at 4> = </>M since (Hw)' (4>{w\—) = (Hm w iw)' (4>[w] — ) = = 
(Hw) 1 (4>[w\+) by (4.17) and Lemma 4.2. Because the function (Hw)(-) is 
continuous everywhere and vanishes outside the closed and bounded inter- 
val [0, it is bounded everywhere. Direct calculation gives immediately 
the equalities in (4.19) and (4.20). The inequality in (4.20) follows from 
substitution of (Hw)((p) = for <f> > <p[w] and that (g + \o(Kw))((j)) > for 
(f> > 4>[w] > <j>e[w\ by Lemma 4.2, where (f>e[w] is the unique root of nonde- 
creasing function (j> \— > (g + Xo(Kw))(4>). For the proof of the inequality in 
(4.19), note that (Hw)'(<j)) equals 

r<f>[w] o n ( 7 \ 

*W / vTm s (g + HKw))(z)dz 

Jtf, a z (z)B(z) 

Jo a 2 (z)B(z) 

for < (ft < <j)[w\. The second term is positive since (i) r](-) is strictly de- 
creasing, and (ii) (Gw)((ft) in (4.17) is strictly negative for <j> £ (0, </>[«;]) by 
Lemma 4.2. The first term is strictly negative for (ft € since (i) 

ip(-) is strictly increasing, and (ii) (g + \q(Kw))(z) > for z > (fti[w]. There- 
fore, {Hw)'{4>) > for (ft € [(fti[w],(ft[w]). Because continuously differentiable 
(Hw)((ft) vanishes at = <j>[w], we have 

(Hw)((ft) = — (Hw)'(z) dz < for every 4>e[w] <(ft< <ft[w]. 



Finally, for every < (ft < (f>i [w] , the strong Markov property of the process 
y*° applied at the F-stopping time t^a w j gives 



(Hw)(d>)=E* 



T MM e -{^)t( g + x Q (Kw)){Y*°)dt 



+ Eq [e" ( a+Ao)t ^ M ] (Hw) (<f>t [w] ) , 

and both terms are strictly negative, since (g + Xq(Kw))(4>) < for (ft € 
[0, (fte[w]) and (Hw)((fti[w\) < by the previous displayed equation. □ 

Proposition 4.1. Suppose w(-) is nondecreasing and nonpositive. Then 



(Jw)(cft) = (Hw)(cft)=K 



e-( A+A °)*( 5 + Ao(^))(y* )^ 



>0. 
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Proof. For every < I < <fi < r and F^-stopping time r, Ito's rule yields 

-(A+Ao)(TAT ; Ar r ), 



(Hw)(cf>) 

I'tAti Ar r 

+ / e -(A+Ao)i^ Q _ (A + x )](Hw)(Y t ^)dt. 



e-( x+Xo ^nY* (H W y(Y* ) dX., 



Since (Hw)'(-) is continuous by Lemma 4.3, it is bounded on [I, r]. Taking 
expectations gives 



f fTATlATr 

(Hw)(cP) +Et 



(A+A )t 







lAo-(\ + \ )}(Hw)(Y* )dt 



>(H«;)(^)-Ej 



TAT;AT r 



because (Hw)(-) satisfies the variational inequalities in (4.19) and (4.20) 
by Lemma 4.3. Since (Hw)(-) = (Hm w ])(-) is nonpositive continuous and 
bounded by the same lemma, letting I — > 0, r — > oo and the dominated con- 
vergence theorem (see Remark 3.2) give 



o>E^[ e - {A+Ao)T (#™)(y* ; 



>(Hw){4>)-K 
Thus, we have 



-{^)\g + \ Q (Kw)){Y? Q )dt 



n 



<*+^)\g + \ Q (Kw)){Y?°)dt 



> (Hw)(</>). 



Taking infimum over F -stopping times r gives (Jw)((p) > (Hw)((ft), 4>> 0. 
If we replace every r above with the first entrance time Tr^i of the 

process Y®° into [(j)[w], oo), then Fq{t < oo} = 1 and the variational in- 
equalities in (4.19) and (4.20) ensure that every inequality above becomes 
an equality. This proves (Jw)((f)) = (Hw)(4>) for every <j) > 0. Finally, that 
equality extends to <f> = by the continuity of (Jw)(-) and (Hw)(-). □ 



Corollary 4.1. Recall the sequence {v n (-)} n >o of functions defined 
successively by (3.2) and its pointwise limit Voo(-), all of which are bounded, 
concave, nonpositive and nondecreasing by Remark 3.3. Then every v n {-), 
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< n < oo, is continuous on [0, oo) continuously differentiable on (0,oo), 
and twice continuously differentiable on (0, oo) \ {4>n}, where 

(4.21) cf) n+ i = <p[v n ], 0<n<oo and 0oo - 0K»] 

are the unique strictly positive roots of the functions (Gv n )(-), < n < oo, 
as in (4.17). Moreover, 

(4.22) v n+ i(-) = (Hv n )(-), 0<n<oc, and i/«>(0 = (#««)(•)■ 
For every n > 0, we have v n {4> n ) = v' n (<f> n ) = 0, and v n+ i(-) and v n (-) satisfy 

r v n+1 (<t>)<o\ 

\ [Ao - (A + A o )K+i(0) + (g + X (Kv n ))(4>) = J ' 

(4.23) 

€ (O,0 n+ i), 

f %+ i(0) = O1 

\ [A - (A + A o )K+i(0) + ( 9 + A o (^ n ))(0) > 0/ ' 

(4.24) 

4> G (0 n +l,Oo). 

TTie function t>oo(-) satisfies Voo(^oo) = ^Jo(^co) = ^ e variational in- 
equalities 

f ^oo(0)<Ol 

\ [A - (A + A )]^oo(^) + (5 + A o (^oo))(0) = / ' 

(4.25) 

</>e (o,^oo), 

/ «aoW = 0l 

1 [A - (A + A )]^oo(^) + (9 + A (i^oc ))(</>) > 0/ ' 

(4.26) 

0e (000,00). 

Proof. Since i>o(-) = is continuous, i>i(-) = (Jt>o)(-) = (Hvq)(-) by 
(3.2) and Proposition 4.1, and t>i(-) is continuous by Lemma 4.3. Then an in- 
duction on n and repeated applications of (3.2), Proposition 4.1 and Lemma 
4.3 prove that every i> re ( - )> < n < oo, is continuous, and that the equali- 
ties on the left in (4.22) hold. Since t>oo( - ) is the uniform pointwise limit of 
the sequence {v n (-)} n >o of continuous functions on R + by Lemma 3.2, it is 
also continuous. Therefore, Lemma 3.1 and Proposition 4.1 also imply that 
^oo(') — (Jvoo)(-) = (Hvoo)(-), which is the second equality in (4.22). The 
remainder of the corollary now follows from (4.22) and Lemma 4.3. □ 

Proposition 4.2. The pointwise limit Uoo(') of the sequence {v n (-)} n >o 
in (3.2) and the value function V(-) of the optimal stopping problem in (2.6) 
coincide. The first entrance time tu^^) of the process of (1.3)-(2.9) 
into the half interval [</>oo,oo) is optimal for the Bayesian sequential change 
detection problem in (1.2) and (2.5). 
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Proof. Let r be an F-stopping time, and r^ r = r^n Af[ r )00 ) for some < 
I <r < oo. Then for every (j) > 0, the chain rule implies that e~ A ( rATi ' r )u 0O ( < I ) 7 A 7 i ) 
equals 



ThTl, 



e~ xt ([A - (A + A )]uoo($t-) + A (K Voo )($ t _)) dt 



+ 



+ 



TAT;. 



rA-n. 



e- A V*t-««(*t-)dX t 



-XI 



Uoo($t-) 



in terms of the (Pq , F)-compensated counting measure ^(di, dz) = p(dt, dz) — 
\odtvo(dz) on [0, oo) x E. The stochastic integrals with respect to X and 
q are square-integrable martingales stopped at some F-stopping time with 
finite expectation by Remark 3.2, since continuous v^(-) is bounded on 
[l,r], and foo(-) is bounded everywhere. Therefore, taking expectations of 
both sides implies that Eq [e~ x( - rAn ^Voo{&~ A ~ )] equals 



Woo (0)+ Eg 



TATj , 



E 



E 



e~ A *([A - (A + Ao)]«oo(*t-) + A (^oc)(^-)) * 
7a7l - -xt 



e- At g($ t -)dt 



TATl . 



e- M g($ t )dt 



since [Aq — (A + Ao)]"yoo( - ) + (g + Ao(i^foo))( - ) > because of the variational 
inequalities in (4.25) and (4.26). Since ^oo(") is bounded and continuous, 
letting I — ► 0, r — ► oo, the bounded and monotone convergence theorems 
give 



e- A ^($ t )dt 



and 



E 



e - A ' 5 ($ t )<ft 



> Woo(0) 



for every F-stopping time r, because Voo(-) is nonpositive. By taking the 
infimum of both sides of the second inequality over all r G F, we find that 
V{4>) > Voo{4>) for every <f> € (0, oo). 

If we replace every f above with the Pg-a.s. finite (by Lemma 4.1) F- 
stopping time tu^oo), then we have Eq [e _Ar ^ oo ' 00 )f 00 ($~ )] = and 
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every inequality becomes an equality by Corollary 4.1. Therefore, V(4>) < 
E J[/Jt*»"»> e- xt g($ t ) dt] = vM). Hence, 



(4.27) V{^)=^t 



/" r [<Aoo,oo) , 



for every (f> > 0, 



and tu^oo) is optimal for (2.6) for every (f> > 0. 

The same equalities at — and optimality of the stopping time tj^^oo) 
when the initial state is follow after taking limits in (4.27) as <f> goes to 
zero if we prove that three functions in (4.27) are continuous at = 0. The 
function Voo(-) is continuous on [0, oo) by Corollary 4.1. If we let f = tL^) 
and r = tu^oo) as in (4.7), then the strong Markov property of <]? at the 
first jump time T% gives 



= 4 



/ e" A * 5 ($ t ) 
Jo 

rrATi rT 

/ e-^C^O^ + l^} / e~ Xt 9(*t)dt 

e - A *i {t<Tl}5 (y*°) a + i {r>Tl}e - AT ^ ( ^/(zoy*» 

e -(A+Ao)*( 5 + A (tfu;))(y*°) dt 



(H^w)^), 0>O, 



which is continuous at = by (4.14). It remains to show that i— > V(0) is 
continuous at = 0. Let us denote by fh and the stopping times m !0O ) 
and Tr^ i00 ) for every h > 0, as in (4.7). Since g(0) < for < < A/c, it is 
never optimal to stop before $ reaches [A/c, oo), and for every < /i < A/c, 
we have 



v(o) = K 



T h ATi 



E 



o 

rTfr ATl 

/ e- A * 5 (^)dt + e" A{r ' lATl V($ 
Jo 

r e - A 'i {t<Tl}5 (y t ' I>( ')dt + i {Th<Tl}e - A ^y(y 7 

</ 



e ~ A ^(^) dt + e- AKATl V(«&~ ATi 



+ iK>T l} ^y^/(z 1 )y T ? 
<*+*o> g (Y?°)dt + e -( A+A «)^y(y r <E> o) 



Ai 



+ 



Th 



< x+x °V\ Q (KV)(Y* )dt 



MULTISOURCE BAYESIAN SEQUENTIAL CHANGE DETECTION 



25 



Th 



-(A+A )t 



(g + \ (KV))(Y*°)dt 



+ V(h) 



because {r^ < T{\ = {t/j < T{] and A T\ = Th A T\ . Since V(-) is bounded, 
the first term on the right-hand side vanishes as h \ by Remark 3.2. 
Because ip(0) > 0, lim/,^ ' ( /'(0)/V'(^) = 1- Therefore, limh\oV(h) exists and 
equals V(0). Hence, V(4>) is also continuous at 4> = 0. □ 

Remark 4.1. The value function V(-) = t>oo( - ) can be approximated 
uniformly by the elements of the sequence {v n (-)} at any desired level of 
accuracy according to the inequalities in (3.10). Since {v n (-)} n >o decreases 
to Voo(-), the optimal continuation region 

C 4 {(f) > : V (0) < 0} = {(j) > : VoD (0) < 0} = [0, 

is the increasing limit of C n 4 > : < 0} = [0, n ), n > 0, and <^oo = 

lim^oo | <j) n . 

Moreover, for every e > and for every n > 1 such that [Ao/(A+ Ao)] n < cs, 
the stopping time T^ n>0O ^ = inf{t > 0; &t > </>n} is e-optimal for (2.6). More 
precisely, 



F(0) < Eq 



e- A * 5 ($t)dt 



< + - 



An 



> 0,n > 1. 



c V A + A , 

Proof. We shall prove the last displayed equation. Since TU nj0O ) is the 

Pg-a.s. finite F-stopping time by Lemma 4.1, as shown for tu^oq) in the 
proof of Proposition 4.2, Ito's rule and the localization argument imply that 



■n 



[0n,oo) 



e- M ([A - (A + Xo)] Voo + \ (Kv oo ))($t) dt 



-E 



[0n,°o) 



e" A * 5 ($t)dt 



since ([A - (A + A )]t>oo + 9 + ^{Kv 00 )){4>) = for every <p £ (O,0„) C 
(0, (poo) according to (4.25). Therefore, for every <j> > 0, we have 



Woo ((A)=E* 



T [0n,o°) 



e- At 5 ($ t )dt 



+ E^[e~ Ar [^^)u 00 ($~ )] 



>E* 



e- xt g{^ t )dt 



+ E^[e" AT ^.-)u n ($: 



[<£n,°°) ' 



If Ar 



c VA + Ar 
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by the second inequality in (3.10). The result now follows immediately be- 
cause we have Pp-a.s. v n (<!>~ ) = by Lemma 4.1 and Corollary 4.1. 

□ 011,00 

5. Quickest detection of a simultaneous change in several independent 
Wiener and compound Poisson processes. Suppose that at the disorder 
time 0, the drift of a d- dimensional Wiener process 

changes from to jl = (p^ , . . . , /i") for some 1 < d < oo and ft € M rf \ {0}. 
Then in the model of Section 2, the likelihood-ratio process of (2.3) and its 
dynamics in (2.4) become 

L,A exp |^_/M[! + Al _ Ao ^| -Q (j^/(Z n )Y t>0, 

dL t = L t fldX t + L t _ fjj^fi*) ~ iJiK* x <k) - Ao<*tx4)(<te)], * ^ °. 

in terms of the d-dimensional observation process 

(5.1) X t = X +fl(t-@) + + W t , t>0. 

The representation in (2.5) of the minimum Bayes risk U(-) in terms of 
the value function V(-) of the optimal stopping problem in (2.6) for the 
conditional odds-ratio process $ of (1.3) remains valid, but instead of (2.8), 
the dynamics of <3? now become 

d$ t = (A + a$ t ) dt + <S>tfidX t 

(5.2) 

+ $ t -J E (j±f(z)-l)p(dtxdz), t>0. 
However, if we define 

(5.3) / ,4|| / 2|| = v /( /i (i)) 2 + --- + (/iW) 2 and X^^—JlX, 

then the one-dimensional process X is a (Pq , F)-Wiener process Pq -independent 
of the marked point process (T n , Z n ) n >\. In terms of the Wiener process X 
and the new scalar (i ^ in (5.3), the dynamics in (5.2) of the sufficient 
statistic $ can be rewritten exactly as in (2.8). Hence, quickest detection 
of a change from to /2 in the drift of a multi-dimensional Wiener process 
is equivalent to quickest detection of a change from to fj, = ||/2|| in the 
scalar drift of a suitable one-dimensional Wiener process. This is true both 
in the absence and presence of an independent and observable marked point 
process whose local characteristics change at the same time G as described 
earlier. 
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Suppose that, in addition to the process X in (5.1), m compound Poisson 
processes n>i, 1 <i <m, independent of each other and the pro- 

cess W, are observed on some common mark space (E, 8). At the same disor- 
der time 0, their arrival time and mark distribution change from (Ag , Vq ) 
to (Aj^,^!^), respectively. Then their superposition forms a new marked 
point process (T n , Z n ) ra >i, which is independent of W, and whose local char- 
acteristics are 




(5.4) (Ao,^)= VA^V^'M and 



before and after the disorder time, respectively. Therefore, the solution 
method of the previous section, as summarized by Remark 4.1, can be ap- 
plied directly with the new choices in (5.3) and (5.4) of parameters fi, Xq, Ai, 
probability distributions vo,ui on (E,£) and processes X and (T n , Z n ) n >i. 

6. Numerical examples. We describe briefly the numerical computation 
of the fundamental solution ip(-) of the ODE (A + Xo)h = A$h and successive 
approximations v n (-), n > 0, in (3.2) of the value function V(-) in (2.6). 
These computations are based on Kushner and Dupuis's [13] Markov chain 
approximation and Monte Carlo estimation of certain expectations. We use 
these methods on several examples and illustrate that reduction in Bayes 
risk can be significant if multiple sources are used simultaneously in order 
to detect an observable disorder time. 

6.1. Calculation of the function ip(-) over a fine grid on some interval 
[0,z]. Let us fix a number z > 0, grid size h > and an integer N such 
that z = Nh. Denote by S h the collection of grid points z n = nh, n > 0. 
Set ijj(z) = 1 (or to any other positive constant). Then we can calculate the 
function ip(-) on the grid S h according to (4.9) if we can evaluate 

(6.1) E^[exp{-(A + X )t z }} for every y, z > 0. 

To do that, we will approximate the diffusion Y in (2.11) with a continuous- 
time process {£ h (t);t > 0} obtained from a discrete-time Markov chain {^; n > 
0} on the state space S h by replacing unit-length sojourn times with state- 
dependent deterministic times. The derivation of one-step transition proba- 
bilities p h (y, v), y,v G S h of the Markov chain n > 0} and "interpolation 
intervals" At h (y), y € S h become more transparent if we set our goal to ap- 
proximate the more general expectation 



(6.2) WiEg 



o 



e-^k(Y t )dt + e-^g(Y Ti 



0<y<z, 
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for some fixed z € S h , discount rate j3 > 0, and bounded functions k(-) and 
g(-). Let us study V$ first (namely, = 0). If we denote the drift and diffusion 
coefficients of the process Y by /i(-) and cr(-), then, under certain regularity 
conditions, we expect Vb(-) to solve the second order ODE 

^Vo'(y) + KvK{y) + k(y) = 0, < y < z, 

subject to boundary condition Vq{z) =g(z). If we replace Vo'(y) and V$(y) 
with their finite-difference approximations 

yh(y + h)+V h (y-h)-2V h (y) 
h? 

V \ y + h)-V, h {y) yh {y) _ V h {y _ h) 

r l[o,c»)(^(yj) H r l(-oo,o)(/^(y)j) 

respectively, then we obtain 

<?\y) VpHv + h) + V£(y -h)- 2V h (y) 
2 h? 

+ 5MH) rt) ^)^ < y <, 

Rearranging the terms implies that Vq 1 ^) equals 
h 2 

+ C r2(y) + %(y)| %) ' 
which can be rewritten as 

Vo h (y) = V h (y-h)p h (y,y-h) 

(6.3) 

+ V h (y + h)p h (y, y + h) + At h (y)k(y) = 0, 
for every y € S h Pi [0, z], if we define 

(6.4) <! a 2 (y) + %(y)| ^ y £ ^ 

At h (y) = — — -r 

Kyj a 2 (y) + h\fi(y)\ 

Let {^ni n — 0} be the discrete-time Markov chain on S h with transition 
probabilities p h (y,y ± h), y G if? , in (6.4), and define the continuous-time 
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process {£ h (t);t>0} on the same space by adding the "interpolation inter- 
val" At h (Cn) before the jump from £ h to namely, 

C h (t) = C h n te[t h n ,t h n+1 ),n>o 



where t 



0, t h n+1 4 t h n + At* n > and At h n 4 At h (^) 



are deterministic functions of the embedded discrete-time Markov chain 
(£n)n>o- Then the solution V h (y), y € S h n [0, z] of (6.3) with the boundary 
condition V h (z) = is the same as the expectation 



(6.5) V h (y)=E% 



He(t))dt + g(t h (T h )) 



yeS h n[0,z] 



The process {£ h (t);t > 0} is locally consistent with {Yt;t > 0}; and there- 
fore, that process and the function V h (-) well approximate {Y t ;t > 0} and 
Vq(-), respectively; see Kushner and Dupuis [13] for the details. In general, 



(6.6) 



-P t k{t h {t))dt + e-l 3rh g{t h {T h )) 



y€S h n[0,z], 



is a good approximation of the function Vg(-) in (6.2), and if we define 



N h ±mf{n>0:£ = z}, 



then (6.6) simplifies to 

\-N h -l 



vHy)=n 



(6.7) 



E Ma 



n=0 







+ exp{-pt% h }g(z 



y eS h n[o,z]. 

In (6.1), (3 = A + Ao, k = 0, and g = 1. Thus, (6.1) is approximated well by 

E^[exp{-(A + A )44] 

for y eS h D [0, z] as well as y £ S h f~) [z, oo). 



(6. 



Finally, we can estimate (6.8) by using Monte Carlo simulation in the fol- 
lowing way: 

(i) Set the initial state Co = V- 

(ii) Simulate the Markov chain £^ until the first time N h that it hits the 
state z G S*. 

(iii) Calculate exp{-(A + A ) En=o _1 A ^(£n)}, which is now a sample 
estimate of (6.8). 
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(iv) Repeat until the standard error of the sample average of individual 
estimates obtained from independent simulation runs reduces to an accept- 
able level. Report upon stopping the sample average as the approximate 
value of (6.8). 

For the calculations in (4.9), notice that initial state y and target state z 
are always adjacent. This usually helps to keep the number of simulations 
low. In the detection problem, the dynamics in (6.4) of the Markov chain 
that approximates the diffusion Y in (2.11) become 



We choose h so small that p h (h,2h) 3> p h (h,0), that is, reaching to from 
inside S h is made almost impossible. 

6.2. Calculation of the successive approximations v n {-), n > 0, in (4.22) 
of the value function V(-) in (2.6). Recall from (3.2), Corollary 4.1 and 
(4.22) that bounded, nonpositive and nondecreasing functions v n (-), n > 0, 
can be found by successive applications of the operator H in (4.13) and 
(4.18). Therefore, it is enough to describe the calculation of (Hw)(-) for a 
bounded, nonpositive and nondecreasing function w(-). 

Since the function ip(-) is now available, the unique root 4>[w] of {Gw){4>) = 
in (4.17) can be found by solving numerically the equation 



By Lemma 4.3, we have (Hw)(<f>) = for every <j> > 4>[w]. Let S h de- 
note once again the grid points z n = nh, n < N, where h > is small and 
zn = <j>[w]. Then by simulating the approximate Markov chain {£n',n > 0} 
with transition probabilities and interpolation interval given in (6.9), we can 
approximate (Hw)(4>) on S h with the Monte Carlo estimate of 



(6.9) 





z 



2[(a/n 2 )-l] e -2\/(n 2 z)^ z ^ g ^ + X Q (Kw)(z)] dz = 0. 



[~N h — l 



h 1 _ e -(A+A )At: 



K n E (5 + A (/^;))(^)e-( A + A «^ 



Th 



n 



. n=0 



A + A 



(6.10) 



at every z n € S h ; 



compare (6.2) and (6.7) with (4.13) and (6.10) when r = <j)[w\. 
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Initialization: Calculate simultaneously 

• the increasing fundamental solution tf)(-) by simulating (6.8) on the interval 

<f><E[0,u]> 

• the function 



and the unique strictly positive solution u = </>[— 1/c] of the inequality 



Tl \ A 2[(a/u 2 )-ll -2A/(u 2 z) ,./ n ^W\ z ) c ^ rn 

7(z) = z LW ^' 'e ip(z) oc lor every z E 0, 

a 2 (z)B(z) 



< y /(z)^g(z) dz cx (Giu)(?i), where w(-) = — -. 

For example, set initially it = 2A/c, calculate the functions ip((f>) and for every 
(j> £ [0,u]. If the above inequality is satisfied, then stop, otherwise, double u and 
repeat. Since — 1/c < !)„(■) < for every n > by Remark 3.3, we have < (j> n <u for 
every n > by Lemma 4.2. Recall that g(z) = z — (A/c), z > 0, and (Gw)(-) are as 
in (2.6) and (4.17), respectively. Finally, set n = 0, 4> n — A/c, and v n {4>) = for every 
< 4> < u. 

Step 1: Calculate the function (Kv„)(-) by using (3.4) and unique root (j> n = 4>e[v n ] 
of the increasing function (g + Xo(Kv n ))(-). 

Step 2: Find the unique strictly positive solution r — <f>„+i of the equation 



0= / I(z)(g+{Kv n ))(z)dz<x(Gv n )(r). 
Jo 

The solution (j>n+i is located in the interval (<f>„ V <f>„ ,u), and Newton's method may 
be used to find it. 

Step 3: Set v n +i{(f>) = for every cf> n +i < <t> < u, and find v„+i((f>) for every < 4> < 
4>n+i by simulating (6.10). Increase n by one and go to Step 1. 

Fig. 1. An algorithm that calculates the approximation v n (-) of the value function V(-) 
and the critical thresholds <j> n for every n > 0; see Remark 4.1. 



6.3. Examples. Figure 1 describes an algorithm that calculates the ap- 
proximations v n (-), n > 0, of the value function V(-) by means of the tools 
described in Sections 6.1 and 6.2. In the following examples, we employ that 
algorithm to compute the approximations v n (-), n>0, until the maximum 
difference between two successive functions is reduced to an acceptable level. 
The termination of the algorithm with guaranteed error bounds follows from 
Lemma 3.2, which also provides an upper bound on the number of successive 
approximations . 

Nine panels in Figure 2 display the approximate value functions corre- 
sponding to nine examples. In each example, the observation process is 
(X, N); the process X is a one-dimensional Wiener process that gains a 
drift \x after the disorder time O, and N is a simple Poisson process whose 
arrival rate changes from Aq to Ai at time G. In all of the nine examples, we 



32 



S. DAYANIK, H. V. POOR AND S. O. SEZER 



0.4 0Y> (1 8 I 




12 3-1 

(a) \ = 1.5, fi - 0.5 



12 3 4 5 

(b) X = 1.5, fi - 1 



I Vlv.i..|| 

Wienef 



I 2 3 4 I 

(c) \ = 1-5, // = 2 



, (1 0.2 0.4 0.6 ft! 



0.2 ft 4 0.6 0.8 1 




(i) Xrj = 6, pi 



Fig. 2. The solutions of the sequential disorder-detection problems for different pre-dis- 
order arrival rate Ao of the Poisson process and post-disorder drift fi of the Wiener process. 
In each case, Ai = A = c= 1. The upper part of each panel displays the Bayes risks U(-), 
Up(-), Ux(-), and the lower part displays the value functions V(-), V^(-), Vx(-) of the 
corresponding optimal stopping problems. Solid curves are the functions U(-) and V(-). 
Curves with "+" are the optimal Bayes risk U p {-) and the value function V p (-) if only the 
Poisson process is observable, and curves with "□" are the Bayes risk Ux( ) and the value 
function Vx(-) if only the Wiener process is observable. The dashed line in the upper part 
is the mapping n 1 — n . It is optimal to raise a disorder alarm as soon as the process 
$/(l + $) of (2.3) enters into the region where U(tt) — 1 — n; equivalently, as soon as $ 
enters the region where V(cj)) = 0. 



have c = 1 and A = Ai = 1 [see (1.2) and (2.1)]; however, the post-disorder 
drift /i of X and the pre-disorder arrival rate Ao of N are different. Across 
every row, [i increases while Ao does not change. Across every column, Ao 
increases while \x does not change. 

The graph in each panel is divided in two parts. The upper part shows 
the optimal Bayes risk U(-) of (2.5) on [0, 1] displayed on the upper horizon- 
tal axis, and the lower part shows the value function V(-) of the stopping 
problem in (2.6) on M + displayed on the lower horizontal axis. Both U(-) 
and V(-) are plotted with solid curves. We compare those functions with 
U p (-), Vp(-), Ux(-) and Vx(-), where U p (-) and Ux(-) are obtained by taking 
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the infimum in (2.5) over the stopping times of (smaller) natural nitrations 
¥ p and F"' 4 ' of N and X, respectively. On the other hand, V p {-) and Vx(-) 
are the value functions of the optimal stopping problems analogous to (2.6), 
that is, 



V p ^) 4 inf Eq 



V x (<j>) = inf 



e -\tU< j P)_± ] 



where 



(p) 



P{G > 1 1 T v t } 



and $ 



9<i 



9>t|^} 



Up(-), Vp(-) and Ux(-), Vx(') are related to each other in the same way as 

17(-), v(0 are in ( 2 - 5 )- 

The differences in the Bayes risks U p (-), Ux(-) and {7(0 provide insights 
about the contributions of observing the processes X and N separately or 
simultaneously to the efforts of detecting the disorder time 0. Sometimes, 
the Poisson process provides more information than the Wiener process, as 
in (d), (g) and (h); sometimes, the Wiener process provides more information 
than the Poisson, as in (b), (c) and (f); and some other times, the difference 
is negligible, as in (a), (e) and (i). In every case, observing the Poisson and 
Wiener processes at the same time provides more information, which is often 
significantly larger than two processes can provide separately, as in (i), (e), 
(f), (h), (d) and (g). 

Intuitively, we expect the contributions to increase as /i and Ao are pulled 
farther apart from and Ai , respectively. The examples displayed in Figure 
2 are consistent with this expectation. The Bayes risks Un(-) and {7(0 are 
shifting downward across every column, and Ux(-) and U(-) do the same 
across every row. 

In (a), fj, and Ao are relatively close to and Ai, respectively; therefore, 
observing both processes at the same time does not improve the optimal 
Bayes risk. Observing only one of them will thus reduce costs without in- 
creasing risks. As the post-disorder drift /i of X is increased along the first 
row, both £7y(0 and 17(0 improve gradually. The function Ux(-) stays close 
to J7(0 because the process X provides more information than N for the de- 
tection of the disorder time. Especially in (c), one may choose not to observe 
the process iV anymore in order to lower the observation costs. Similarly, if 
H is close to 0, an increase in the difference between Ao and Ai makes i7 p (0 
drive U(-) to lower levels; see the first column. 
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6.4. Numerical comparison with Baron and Tartakovsky's asymptotic anal- 
ysis. Let us denote the Bayes risk R t (tt) in (1.2), minimum Bayes risk U(ir) 
in (2.5) by R T (ir,c) and U(ir,c), respectively, in order to display explicitly 
their dependence on the cost c per unit detection delay. Let us also define 

A (^ 2 /2) + Ap + Ai[log(Ai/A ) - 1] + A 

(6.11) 

tt \ A logC w n 

/( C ) = -77T: C>0 - 

0(c) 

Baron and Tartakovsky ([1], Theorem 3.5) have shown that the stopping 
time t(c) = inf{i > 0; &t > <K C )} is asymptotically optimal and that the 
minimum Bayes risk U(n,c) asymptotically equals /(c) for every fixed tt € 
[0, 1), as the detection delay cost c decreases to zero, in the sense that 

U(tt,c) R t {c){k,c) 

iim — —. . = lim — = 1 for every tt £ 0,1. 

c\o /(c) c\o /(c) 

In this subsection we revisit the example displayed in Figure 2(h), where 
Ao = 6 and Ai = A = /i = 1. We have calculated optimal thresholds, minimum 
Bayes risks and their asymptotic expansions in (6.11) for eighteen values of c 
(0.02, 0.04, . . . , 0.18, 0.20, 0.30, . . . , 0.90, 1); see Figure 3. If only the Poisson or 
Wiener process is observable, then the asymptotic expansions of the optimal 
thresholds and their minimum Bayes risks U p (-), Ux(-) also follow from 
(6.11) by setting fj, = in the Poisson case and by letting Ao = Ai in the 
Wiener case, respectively. The critical thresholds and minimum Bayes risks 
are calculated in Figure 3(c) by using the numerical algorithm in Figure 1, in 
Figure 3(a) by using Dayanik and Sezer's [9], Figure 2 numerical algorithm, 
and in Figure 3(b) by solving numerically the integral equation 

[w-(l/c)]ipx(w)_ dw = 



lo e 2 / w 

for the critical value i^oo and by numerically evaluating Vx(4>) = 

4* W ^ dw + vx ^ J jfc dw 

in Uxin) = 1 — tt + c(l — tt)Vx(tt/[1 — it]), in terms of 

^.oo e 2/w 

V>x (</>) = 1 + </> and n x ((t>) = (l + 4>) 2n ■ — y>dw; 

see also Shiryaev ([17], page 201, Theorem 9). 

Optimal critical thresholds and their asymptotic expansions seem to be in 
good agreement; this is especially clear for small c values as Baron and Tar- 
takovsky [1] predicted (as c decreases, the distance between any two curves 
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Fig. 3. Optimal thresholds, minimum Bayes risks and their asymptotic expansions at 
c = 0.02, 0.04,..., 0.18, 0.20, 0.30,..., 0.90,1 for (a) Poisson, (b) Wiener and (c) combina- 
tion of Poisson and Wiener observations (Ao = 6, Ai = A = /1 = 1). 

in the first row does not grow faster than the critical thresholds themselves, 
hence, the relative error converges to zero). In the second row, the Bayes 
risks at three fixed values, tt = 0, 0.5, 0.8 (one in the middle and two close to 
end-points of the range [0, 1]), also seem in good agreement with the asymp- 
totic expansions for small values of detection delay cost c. As a reference, 
we have also plotted the minimum Bayes risks at optimal critical thresholds, 
which do not have to agree closely with the asymptotic expansions, because 
in this case minimum Bayes risks are evaluated at different tt values as c 
changes, and their asymptotics do not immediately fall inside the scope of 
Theorem 3.5 of Baron and Tartakovsky [1]. 



APPENDIX 



A.l. The boundary behavior of the diffusion process Y y . Once we ver- 
ify (4.2) and (4.3), the conclusions follow from Karlin and Taylor ([12], 
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Chapter 15), who expressed the quantities in (4.2) and (4.3) in terms of 
the measures S(0,x] = j^ + S(dy) and M(0,x] = ^ + M{dy), and integrals 
E(0) = f* + S(0,£]M(dO, JV(0) = fQ + M(0,£]S(dO for the left boundary at 
0, and £(oo) = S(£,oo)M{dO, N(oo) = J™ M(£ oo)S(d£) for the right 
boundary at oo. Since only the finiteness of E(-) and N(-) matters, the value 
of x > in the domain of those integrals can be arbitrary. One finds that 

S{dy)= Cl y~ 2a ^ 2 e 2X /^ 2y) dy 

and 

M(dy) = c 2 y 2[{a/fl2) - 1] e - 2A /(^) dy, y > 0; 

above, as well as below, ci,C2,... will denote positive proportionality con- 
stants. Therefore, changing the integrating variable by setting z = 1/y gives 



S(x) - S(0+) = / S(dy) 

= d [°° z (VM 2 )-2 e (2A/^ )z ^ = +oq yx> 
Jl/x 

and the first equality in (4.2) follows. After applying the same change of 
variable twice, the double integral in the same equation becomes 

/■oo / POO \ 

(A.l) N(0)=c 3 [ u a e^ u du)v~ a - 2 e Pv dv 



'l/x \Jv 

in terms of a = — 2a/ n 2 € M and (3 = 2X/ fi 2 > 0. Integrating the inner inte- 
gral by parts k > times gives that, for every k > 0, 

Jv ±1 (a -j ! 



^-(fe + l) /-OO 

/ o„,a-k -f3u 



/ n Q e- /3u (iu<y-^ — v <*-3 e -P» k>m&x{0,a}. 

Jv -f-t, (a-j)\ ~ 1 ! 



pu a - K e- pu du. 

(a-ky. J v 

If k > a, then u i— » u a_fc is decreasing and the integral on the right is less 
than or equal to v a ~ k Pe~@ u du = v a ~ k e~@ v . Therefore, 

Using this estimate in (A.l) implies that, for every x > 0, 

N(0) < a ; P ~ 0+ \ «-ie-{A v~ a - 2 e^ dv 



% (a-j)\ Ji/ X 
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which completes the proof of (4.2). Since <S(0+) = — oo and N(0) < oo, the 
left boundary at is an entrance-not-exit boundary. 

For the proof of (4.3), notice that change of variable by u = 1/y gives for 
every z > that 

S(dy) = / vT a - 2 e Pu du > / u~ a ~ 2 du 



o 



-(a + l) -1 * * 1 , a+l<0, 
oo, a + l>0. 

If a + 1 > 0, then clearly £(oo) = f£° S{dy)M{dz) = oo for every x > 0. 
If a + 1 < 0, then for every i>0we also have 

roo roc roc 

S(oo)= / / S(dy)M(dz)> -{a + l)~ 1 z a+1 M(dz) 



roc rc 

= -(a + l)- l c 2 / z a+1 z- a - 2 e- p/z dz = c A 

J X J X 

POC 

> C4e _/3//a: / z" 1 dz = oo, 



^e-W'dz 



and the first equality in (4.3) is proved. Similarly, changing variable by 
v = l/y gives 

rl/z r^/ z 
M(dy) = / v a e~ l3v dv > e~ p/z / v a dv 



(a + l)- 1 i a+1 e-^ z , a + l>0, 
oo, a + l<0. 

If a + 1 < 0, then clearly iV(oo) = J™ M(dy)S(dz) = oo for every x > 0. 
If a + 1 > 0, then for every x > we also have 



X J z 
oo 



N{oo)= I I M(dy)S(dz)> (a + irV+V^^cfe) 

z J X 

\a + I)" V+V^sV/* ^ = c 5 /°° z 2a+1 



Cl 



which completes the proof of (4.3). Because £(oo) = N(oo) = oo, the right 
boundary at oo is a natural boundary. 



A. 2. Continuity of <j> i— »• (H r w)((fi) at <fi = 0. We shall prove the second 
equality in (4.14), namely, (H r w)(0) = ]hn^\ \hn.i\ (Hi j7 .w)((j)) = 
lim < j 1 \^Q(H r w)((f)), which implies along with the first equality in (4.14) that 
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<j> i — > (H r w)(4>) is continuous at (ft = 0. For every < h < r, 



(M(o) 



E 



-(A+A )t 



( 5 + A (^))(y t *°)dt 



+ 



-(A+A )i 



(g + \ (Kw))(Y*°)dt 



n, 



E' 



T7l 



-(A+A )t 



(g + \o(Kw))(Y?°)dt 



+ e 



-(\+\ )r h 



K 



e-( x+ W(g + \ (Kw)){Y? )dt 
+ (H r w)(h)E° e- {x+Xo)Th 



K 



+ (H r w){h) 



i>{h) 



h\0 



0+ lim( H r w)(h) ■ 1, 



where the second equality follows from the strong Markov property of Y®° 
applied at the F-stopping time = inf{t > 0;Y®° = /i}, and the fourth 
equality from (4.8). As h \ 0, Pj]-a.s. \ since is an entrance-not-exit 
boundary, and the integral and its expectation in the last equation vanish 
by the bounded convergence theorem. Moreover, since ip(0) = '0(0+) > by 
(4.4), we have limh\o ip(0)/ip(h) = 1. Therefore, limh\o(H r w)(h) must exist, 
and taking limits of both sides in the last displayed equation completes the 
proof. 

A. 3. Calculation of (Hi, r w)(-) in (4.15). Let us denote the function on 
the right-hand side of (4.15) by Hw(<fi), I < <p < r. It can be rewritten in the 
more familiar form 



Hw(4>) 



Gi,r((f>, z)(g + \ (Kw))(z) dz, 



K6<r, 



by means of the Green function 

Tpl((j) Az)r] r ((j) V z) 



Gl, r (4>, z) 



I <<b,z < r, 



<T 2 (z)W l:r (z) ' 

for the second order ODE 

(A.2) [Ao - (A + A )]ff (<£) = -(<? + A o (i^))(0), 

I <<p <r, with boundary conditions H(l+) = H(r- 



0. 
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Therefore, the continuous function Hw ((/>), /<</>< r, is twice continuously 
differentiable on (l,r) and solves the boundary value problem in (A. 2). If 

n,r = T[o,i] A T[r,oo), Ito's rule gives 

= r r e^ x+x ^[A - (A + \ )]Hw(Y*°)dt 
Jo 

+ f Tl ' r e-& + *K(Y t *°)Hv/{Y* )dX t 
Jo 

TLr e- (A+Ao) *((7 + \ (Kw))(Y*°)dt 

TLr e-^ +Xo)t a{Y^ )Hw'{Y t ^ )dX u 

where Pq a.s. Hw(Y®°) = 0, since Hw(l) = Hw(r) = and the first exit time 
T^ r of the regular diffusion Y* from the closed bounded interval [I, r] ^ [0, oo) 

is always Pq a.s. finite. Moreover, the stochastic integral with respect to 
the (Po,F)-Wiener process X on the right-hand side has zero expectation 
because the derivative Hw'(4>), given by 

MM r 2^w\j 9 + MKw))(z)dz 
J<j> a z {z)W^ r {z) 

+ r l'r( ( f>) f 2?tw\ A 9 + MKw))(z)dz, 

J i a z {z)Wi tr (z) 

of Hw(4>), is bounded on S [U r \- Therefore, taking expectations of both 
sides gives 

< x +*>)\g + \ Q (Kw)){Y?°)dt 



Hw(<f>)=E$ 



= (H r w){<t>), 

K6<r. 
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